Predictive validity of a new integrated selection process for medical school admission
نویسندگان
چکیده
BACKGROUND This paper is an evaluation of an integrated selection process utilising previous academic achievement [Universities Admission Index (UAI)], a skills test [Undergraduate Medicine and Health Sciences Admission Test (UMAT)], and a structured interview, introduced (in its entirety) in 2004 as part of curriculum reform of the undergraduate Medicine Program at the University of New South Wales (UNSW), Australia. Demographic measures of gender, country of birth, educational background and rurality are considered. METHOD Admission scores and program outcomes of 318 students enrolled in 2004 and 2005 were studied. Regression analyses were undertaken to determine whether selection scores predicted overall, knowledge-based and clinical-based learning outcomes after controlling for demographics. RESULTS UAI attained the highest values in predicting overall and knowledge-based outcomes. The communication dimension of the interview achieved similar predictive values as UAI for clinical-based outcomes, although predictive values were relatively low. The UMAT did not predict any performance outcome. Female gender, European/European-derived country of birth and non-rurality were significant predictors independent of UAI scores. CONCLUSION Results indicate promising validity for an integrated selection process introduced for the Medicine Program at UNSW, with UAI and interview predictive of learning outcomes. Although not predictive, UMAT may have other useful roles in an integrated selection process. Further longitudinal research is proposed to monitor and improve the validity of the integrated student selection process.
منابع مشابه
Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference.
Assessment for selection in medicine and the health professions should follow the same quality assurance processes as in-course assessment. The literature on selection is limited and is not strongly theoretical or conceptual. For written testing, there is evidence of the predictive validity of Medical College Admission Test (MCAT) for medical school and licensing examination performance. There ...
متن کاملConstruction and Validation of the scale of "possible harms in major selection for university admission
The aim of the present study was to construct and validate the Scale of possible harms in major selection for university admission. The research method used in this study was the mixed method and the statistical population was the incoming students of Tabriz University and Tabriz University of Medical Sciences in the 2021-2022 academic year. In the qualitative section, a sample of 24 students f...
متن کاملSame admissions tools, different outcomes: a critical perspective on predictive validity in three undergraduate medical schools
BACKGROUND Admission to medical school is one of the most highly competitive entry points in higher education. Considerable investment is made by universities to develop selection processes that aim to identify the most appropriate candidates for their medical programs. This paper explores data from three undergraduate medical schools to offer a critical perspective of predictive validity in me...
متن کاملThe Predictive Validity of a Text-Based Situational Judgment Test in Undergraduate Medical and Dental School Admissions.
PROBLEM Situational judgment tests (SJTs) can be used to assess the nonacademic attributes necessary for medical and dental trainees to become successful practitioners. Evidence for SJTs' predictive validity, however, relates predominantly to selection in postgraduate settings or using video-based SJTs at the undergraduate level; it may not be directly transferable to text-based SJTs in undergr...
متن کاملThe predictive validity of the MCAT for medical school performance and medical board licensing examinations: a meta-analysis of the published research.
PURPOSE To conduct a meta-analysis of published studies to determine the predictive validity of the MCAT on medical school performance and medical board licensing examinations. METHOD The authors included all peer-reviewed published studies reporting empirical data on the relationship between MCAT scores and medical school performance or medical board licensing exam measures. Moderator variab...
متن کامل